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PREFACE 


In  response  to  national  welfare  reform  legislation — the  Personal 
Responsibility  and  Work  Opportunity  Act  (PRWORA) ,  which  was  signed  in 
August  1996  and  went  into  effect  in  January  1997--California  passed 
legislation  that  replaced  the  existing  Aid  to  Families  with  Dependent 
Children  (AFDC)  and  Greater  Avenues  to  Independence  (GAIN)  with  the 
California  Work  Responsibility  to  Kids  (CalWORKs)  program.  Following  an 
open  and  competitive  bidding  process,  the  California  Department  of 
Social  Services  (CDSS) ,  which  administers  CalWORKs,  awarded  a  contract 
to  evaluate  the  CalWORKs  program  to  RAND. 

This  testimony-presented  at  a  hearing  of  the  California  State 
Senate  Committee  on  Health  and  Human  Services  meeting  in  Montebello, 
California,  on  December  8,  1999--discusses  some  preliminary  results  from 
the  evaluation  on  the  pace  of  implementation  of  CalWORKs  in  the  counties 
and  the  implications  of  that  pace  of  implementation  for  past  and  future 
spending  and  referrals.  Although  this  testimony  is  based  on  a  variety 
of  sources,  including  research  conducted  at  RAND,  the  opinions  and 
conclusions  expressed  are  those  of  the  author  and  should  not  be 
interpreted  as  representing  those  of  either  RAND  or  those  of  any  of  the 
agencies  or  others  sponsoring  the  research,  including  CDSS.  The  second 
process  analysis  report,  to  be  released  in  late  February  2000,  will 
present  final  results  and  additional  detail. 

RAND  is  a  nonprofit  institution  that  helps  improve  policy  and 
decisionmaking  through  research  and  analysis. 

For  more  information  about  the  evaluation,  see 
http://www.rand.org/CalWORKs  or  contact: 


Jacob  Alex  Klerman 
RAND 

1700  Main  St 
Santa  Monica,  CA  90406 
(310)  393-0411,  x6289 
klerman@rand . org 


Aris  St.  James 
CDSS 

744  P  Street,  MS  12-56 
Sacramento,  CA  98514 
(916)  657-1959 
astjames@dss.ca.gov 
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OPENING  REMARKS 

Good  morning.  My  name  is  Jacob  Klerman.  I  am  a  Senior  Economist 
at  RAND  in  Santa  Monica,  California;  a  Professor  of  Economics  in  RAND's 
Graduate  School  of  Public  Policy;  and  the  Principal  Investigator  of  the 
RAND  Statewide  CalWORKs  Evaluation,  a  legislatively  mandated  study  to 
provide  the  California  legislature  with  a  "comprehensive,  independent, 
statewide  evaluation."  RAND  is  a  nonprofit  institution  that  helps 
improve  policy  and  decisionmaking  through  research  and  analysis. 

My  testimony  today  is  based  on  a  variety  of  sources,  including 
research  conducted  at  RAND  as  part  of  the  Statewide  CalWORKs  Evaluation. 
An  earlier  and  more  detailed  version  of  the  findings  presented  in  this 
testimony  was  presented  at  the  Evaluation's  Advisory  Committee  meeting 
in  October  1999,  and  a  final  version  of  this  material  is,  by  contract, 
to  be  released  to  the  legislature  in  late  February  2000.  That  said,  the 
opinions  and  conclusions  expressed  here  are  mine  and  should  not  be 
interpreted  as  representing  the  opinions  of  RAND  or  the  opinions  of  any 
of  the  agencies  or  others  sponsoring  the  research,  including  the 
California  Department  of  Social  Services. 

I  conclude  these  opening  remarks  with  a  brief  methodological 
comment.  My  testimony  this  morning  is  based  primarily  on  our  field  work 
in  24  counties  throughout  the  state  over  the  period  April  to  August  of 

1999.  This  field  work  consisted  primarily  of  semistructured  interviews 
with  senior  leadership  and  line  workers  in  county  welfare  departments. 
For  the  most  part,  the  testimony  does  not  rely  on  hard  numbers.  As  I 
will  discuss,  few  county  welfare  departments  could  give  us  management 
reports  that  provide  much  insight  into  speed  of  implementation  issues. 

We  are  addressing  this  data  problem  as  part  of  our  broader  evaluation 
effort.  In  parallel  with  our  field  work,  we  are  analyzing  county  data 
systems  themselves.  Preliminary  results  of  that  analysis  should  be 
available  in  the  spring  of  2000,  with  results  to  be  published  in  October 

2000.  At  that  time,  we  should  have  a  more  quantitative  characterization 
of  the  status  of  implementation  in  our  six  focus  counties:  Alameda, 
Butte,  Fresno,  Los  Angeles,  Sacramento,  and  San  Diego. 
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OVERVIEW 

Let  me  begin  by  providing  an  overview  of  our  basic  story.  I  will 
then  return  to  the  story  and  provide  some  detail  for  each  of  the  points. 
Concerns  have  been  raised  about  the  slow  pace  of  implementation  of 
Cal WORKs  and,  specifically,  about  large  carry-overs  of  funds  and  low 
referrals  to  education,  training,  and  treatment  for  substance  abuse, 
mental  health,  and  domestic  abuse  problems. 

Our  analysis  allows  us  to  explain  why  implementation  has  been  slow, 
spending  has  been  below  budget,  and  referrals  have  been  low.  Figure  1 
sums  up  the  key  points  of  our  analysis  on  this  subject. 


Why  Has  Implementation  Been  Slow? 


•  Workload  increased 

•  Requiring  CWDs  to  add  capacity 

•  Cases  need  to  move  through  the  early  steps  of  the 
CalWORKs  process 

•  In  a  “work  first”  program,  only  then  will  referrals  occur 

Monitorable:  Time  to  first  WTW  activity,  sanction,  or  work 

Ameliorable:  Add  “enough”  capacity 

rand  Statewide 

^  CalWORKs 

i—I  Evaluation 

Figure  1 — Why  Has  Implementation  Been  Slow 

As  I  will  discuss,  CalWORKs  massively  increased  the  workload  of  the 
county  welfare  departments,  requiring  them  to  add  capacity — either  in- 
house  staff,  outside  contractors,  or  both.  Bringing  that  additional 
capacity  on-line  took  time.  Only  once  the  additional  capacity  was  on¬ 
line  could  the  work  of  actually  moving  the  existing  and  new  cases 
through  the  early  steps  of  the  CalWORKs  model  proceed.  In  many 
counties,  that  capacity  did  not  come  on-line  until  the  summer  of  1999  or 
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even  later.  Moreover,  CalWORKs  is  a  work- first  program,  and  thus  large 
numbers  of  referrals  would  not  be  expected  until  cases  complete  the 
early  steps  of  the  CalWORKs  model.  This  could  not  occur  until  several 
months  after  the  increased  capacity  came  on-line.  This  analysis 
suggests  that,  in  as  much  as  capacity  has  finally  come  on-line,  the 
situation  should  be  improving.  In  other  words,  expenditures  should  be 
rising  and  referrals  should  be  increasing.  The  limited  evidence  we  have 
so  far  suggests  that  things  are  indeed  improving. 

However,  while  we  can  explain  why  implementation  has  been  slow, 
these  explanations  do  not  change  the  reality:  Many  CalWORKs  recipients 
are  now  two  years  into  their  five-year  lifetime  time  limit  and  have 
still  not  received  many  of  the  services  that  the  CalWORKs  legislation 
provides.  Similarly,  new  cases  are  not  being  moved  promptly  through  the 
sequence  of  activities  specified  in  the  CalWORKs  legislation.  Finally, 

I  will  argue  that  this  situation  can  be  monitored  (we  suggest  outcomes 
to  monitor)  and  that  the  situation  can  be  ameliorated  (by  adding  enough 
capacity) . 

WORKLOAD 

To  understand  the  pace  of  implementation  of  CalWORKs,  it  helps  to 
take  a  step  back  and  understand  what  the  CalWORKs  legislation  expected 
of  a  county  welfare  department.  The  welfare  caseload  has  declined  by 
about  a  third,  so  many  observers  assumed  that  the  workload  and,  thus, 
the  required  staffing  to  meet  that  workload,  could  also  decrease. 

However,  the  reality  has  been  quite  different:  The  workload  has 
increased. 

Compared  to  AFDC  and  GAIN  programs  that  it  replaced,  the  CalWORKs 
legislation  had  a  different  and  more  intensive  vision  of  service 
delivery.  Welfare-to-work  services  that  had  been  previously  provided  to 
only  a  quarter  of  the  caseload  were  to  be  nearly  universal  under 
CalWORKs.  As  more  people  were  required  to  participate,  it  was  clear 
that  more  would  not  comply  and  that  county  welfare  departments  would 
need  to  process  more  sanctions.  In  addition,  both  as  a  result  of  the 
reforms  and  of  the  improving  economy,  more  cases  were  working;  this,  in 
turn,  requires  more  effort  to  record  monthly  earnings  of  those  working 
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and  to  recompute  their  grants .  Finally,  someone  had  to  arrange  for  the 
new  services  to  be  provided  under  the  legislation — child  care, 
education,  training,  and  treatment  for  mental  health,  substance  abuse, 
and  domestic  abuse  problems.  Clearly,  more  "capacity"  (staff  or 
contractors)  would  be  needed  to  handle  each  case. 

This  analysis  refers  to  the  steady-state  workload.  In  the  short¬ 
term,  the  situation  was  even  more  dire.  Not  only  did  the  county  welfare 
departments  have  to  process  new  cases  through  this  expanded  set  of 
activities,  they  also  needed  to  process  many  of  the  existing  cases 
through  those  same  activities.  In  most  counties,  there  were  about  ten 
times  as  many  existing  cases  as  there  would  be  new  cases  in  any  given 
year. 

All  things  considered,  counties  could  project  that  their  short-term 
workload  would  double  or  triple.  Clearly,  additional  capacity  would  be 
needed . 

ADDING  CAPACITY 

Adding  capacity,  whether  in  the  form  of  new  in-house  employees  or 
in  the  form  of  new  outside  contractors,  would  prove  to  be  neither  easy 
nor  instantaneous .  Any  new  capacity  needed  to  be  arranged  and  then 
added  simultaneously  with  the  county  welfare  department's  efforts  to 
design  and  implement  new  welfare  programs  consistent  with  the  CalWORKs 
legislation.  Furthermore,  in  many  counties,  the  Board  of  Supervisors  or 
the  Chief  Administrative  Officer  was  strongly  opposed  to  hiring  in 
general  and  for  welfare  programs  in  particular.  In  other  counties,  the 
Board  of  Supervisors  and  the  public-sector  unions  were  strongly  opposed 
to  outsourcing.  In  either  case,  the  nature  of  government  hiring  and 
contracting  implied  that  new  capacity  could  not  be  brought  on-line 
instantaneously.  Further  complicating  the  management  problem,  once  the 
existing  caseload  moved  through  the  system,  the  workload  would  decrease. 
Thus,  county  welfare  departments  needed  to  expand  capacity  in  a  way  that 
could  be  contracted  once  the  existing  caseload  was  processed.  Finally, 
in  many  counties,  there  were  further  delays  for  reorganization  of  the 
workforce,  reclassification  studies,  union  issues,  lawsuits,  and 
shortages  of  space  in  which  to  put  new  employees  and  contractors. 
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We  can  divide  the  counties  into  three  groups  in  terms  of  how  they 
dealt  with  the  need  to  add  capacity: 

•  A  few  counties  had  large  GAIN  programs  or  successful,  flexible 
contracts  in  place.  They  ramped  up  quickly,  putting  sufficient 
capacity  in  place  before  the  end  of  1998. 

•  Most  counties  were  not  so  favorably  situated.  They  moved 
promptly  to  add  capacity,  but  new  contracts  did  not  yield  new 
capacity  until  early  in  1999.  Hiring  and  then  back-filling 
positions  vacated  as  lower- level  employees  moved  into  the  newly 
created  positions  took  even  longer.  Many  county  welfare 
departments  report  that  they  had  not  completed  hiring  until  the 
summer  of  1999. 

•  Finally,  some  counties,  apparently  including  many  of  the  larger 
ones,  encountered  one  of  the  serious  obstacles  I  listed  earlier, 
did  not  act  promptly,  or  underestimated  the  workload.  Even  now, 
they  find  themselves  without  sufficient  capacity  to  begin  to 
work  through  the  backlog  of  existing  cases. 

EXPLAINING  SLOW  IMPLEMENTATION 

Given  this  analysis,  we  can  explain  much  of  the  experience  of  the 
last  two  years  and  provide  constructive  comments  for  the  future.  County 
welfare  department  expenditures  will  not  rise  until  the  new  capacity 
(staff  or  contractors)  are  on-line  and  billing.  In  as  much  as  CalWORKs 
programs  have  an  effect,  recipients  will  not  be  more  likely  to  get  jobs 
until  they  participate  in  job  search/ job  club  and  as  necessary  the 
follow-on  welfare-to-work  activities.  Child  care  expenditures  will  not 
rise  until  recipients  are  actually  in  activities  or  work  requiring  child 
care.  Referrals  to  education,  training,  and  treatment  for  mental 
health,  substance  abuse,  and  domestic  abuse  problems  will  not  increase 
until  recipients  are  screened  for  such  services  after  failing  to  find 
work. 

For  these  referrals,  the  crucial  timing  issue  when  does  a  recipient 
start  the  first  welfare  to  work  activity,  as  shown  in  Figure  2.  In  a 
"pure"  work- first  program,  services  are  only  provided  to  make  people 


J 


-  6  - 


employable,  and  the  labor  market  is  viewed  as  the  best  test  of 
employability.  Some  people  who  we  would  have  deemed  clearly  employable 
will  not  find  jobs;  others  who  we  would  have  deemed  clearly  not 
employable  will  find  jobs.  Therefore,  everyone  is  sent  to  job  search. 
People  who  find  a  job  have  revealed  that  they  do  not  need  the  services. 
Only  those  who  do  not  find  a  job  are  referred  to  services.  This  will 
not  occur  until  after  they  are  formally  assessed  and  have  signed  a 
welfare  to  work  plan.  This  accounts  for  the  solid  lines  from  welfare  to 
work  plan  to  the  yellow  boxes  in  Figure  2. 
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Figure  2 — The  CalWORKs  Model 


However,  CalWORKs  is  not  a  "pure"  work-first  program.  Formal  and 
informal  guidance  from  the  state  and  the  choices  of  many  counties  imply 
that  some  people  will  be  referred  before  job  search  (the  dotted  lines 
from  orientation/appraisal  to  the  yellow  boxes  in  Figure  2),  while 
others  will  be  referred  concurrently  with  employment  (the  dotted  lines 
from  employment  to  the  yellow  boxes  in  Figure  2) .  Nonetheless,  the 
basic  insight  is  correct:  In  a  work-first  program  such  as  CalWORKs, 
most  referrals  would  be  expected  to  take  place  as  a  welfare-to-work 
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activity,  following  assessment  and  the  signing  of  a  welfare-to-work 
plan.  For  referrals  to  occur  through  this  primary  path,  recipients 
actually  have  to  reach  assessment  and  then  sign  welfare  to  work  plans. 


the  effects  of  capacity 

The  crucial  question  then  is:  When  do  recipients  reach  job  search 
and  the  follow-on  welfare-to-work  activities  that  are  the  core  of  the 
CalWORKs  program  model?  In  an  ideal  program  with  sufficient  capacity,  a 
new  recipient  should  be  able  to  sign  a  plan  and  begin  the  first  welfare- 
to-work  activity  within  ten  weeks  of  the  approval  of.  her  application,  as 
represented  by  the  green  bars  on  Figure  3) . 
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“If  it  takes  longer,  we  lose  the  message: 

Aid  is  connected  to  jobs.  Time  on  aid  is  limited. 
The  clock  is  ticking.” 
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Figure  3 — Time  to  Referral 


Reading  across  the  green  bars  in  the  figure,  we  see  that  intake  (or 
approval)  would  take  place  in  week  1;  orientation/appraisal,  in  week  2; 
four  weeks  of  job  search/ job  club,  in  weeks  3-6;  assessment,  in  weeks  7- 
8;  signing  a  welfare-to-work  plan,  in  week  9;  and  beginning  the  first 
welfare-to-work  activity,  in  week  10. 
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Although  this  is  a  schedule  county  welfare  departments  can  aspire 
to,  it  is  very  hard  schedule  to  achieve.  Doing  so  would  require  having 
sufficient  capacity  so  that  each  step  can  occur  almost  immediately  after 
the  previous  step,  even  given  short-term  variation  in  the  caseload. 

Instead,  in  many  counties,  there  is  a  gap  of  a  month  or  more 
between  each  step  (the  red  bars  in  Figure  3).  Thus,  what  might  take  as 
little  as  ten  weeks,  takes  six  months  or  more.  The  end  result  is  that 
two  years  after  CalWORKs  became  effective,  many  of  the  existing  cases 
have  not  yet  begun  a  first  welfare-to-work  activity;  in  some  cases,  they 
have  not  even  begun  job  search/ job  club. 

Shortening  this  schedule  requires  two  things: 

•  First,  the  county  needs  to  have  enough  capacity; 

•  Second,  the  county  needs  to  have  administrative  procedures  and 
data  systems  in  place  to  ensure  that  cases  don't  get  "lost." 

MONITORING  CalWORKs  OUTCOMES 

This  analysis  suggests  an  approach  to  monitoring  CalWORKs  outcomes. 

We  want  to  know  how  fast  cases  are  moving  past  the  initial  phase  of  the 
CalWORKs  model— job  search.  There  are  three  different  ways  to  leave  this 
initial  phase  of  the  CalWORKs  model:. 

1.  Some  participants  complete  job  search  without  find  a  job.  They 
enter  the  next  phase  after  they  are  assessed,  sign  a  welfare  to 
work  plan,  and  begin  a  welfare-to-work  activity  (the  center 
column  and  the  bottom  row  of  Figure  2),  but  they  are  probably 
the  smallest  group. 

2.  More  participants  appear  to  be  noncompliant ;  their  county 
welfare  department  has  instructed  them  to  participate  in  some 
activity,  but  they  have  not  done  so  (the  left  column  of  Figure 
2,  in  red  because  this  is  the  worst  outcome).  For  them,  the 
county  welfare  department  should  have  begun  the  formal 
noncompliance  process  by  sending  a  Notice  of  Action,  and  then 
following  it  up  by  imposing  a  sanction  (cutting  the  benefit) . 

3.  More  participants  are  working  or  have  left  aid  (the  right  column 
of  Figure  3,  in  green  because  this  is  the  desired  outcome) 
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We  would  like  to  know  what  percentage  of  cases  are  in  each  of  these 
three  groups  (or  paths);  either  in  a  welfare-to-work  activity,  or  deemed 
noncompliant ,  or  working  (including  leaving  aid) ;  and  how  these 
percentages  change  over  the  weeks  following  intake  approval.  It  should 
be  possible  to  get  cases  to  this  point  in  ten  weeks  or  less.  If  after 
twelve  to  sixteen  weeks  a  case  is  not  in  one  of  these  three  groups, 
something  is  wrong.  The  recipient's  clock  is  ticking,  but  he  or  she  is 
not  receiving  the  services  provided  for  in  the  CalWORKs  legislation 

A  similar  analysis  applies  to  the  cases  who  have  been  continuously 
on  aid  since  CalWORKs  began  in  January  1998.  Now,  two  years  after 
implementation,  every  one  of  those  cases  should  be  in  one  of  these  three 
groups.  Otherwise,  two  years  of  their  five-year  lifetime  limit  has  been 
spent  without  receiving  the  basic  CalWORKs  services. 

Unfortunately,  many  counties  appear  to  be  far  from  these  goals  both 
for  new  cases  and  for  existing  cases.  Exactly  how  far  and  the  relative 
success  of  California's  58  counties  is  not  clear.  As  I  noted  at  the 
outset,  most  county  welfare  departments  could  not  provide  management 
reports  that  clearly  described  the  status  of  implementation. 

This  inability  of  counties  to  report  such  information  is  troubling 
beyond  our  desire  to  monitor  CalWORKs  implementation.  A  standard 
management  adage  posits:  "What  gets  measured  gets  done."  If  counties 
are  not  measuring  these  outcomes— for  the  county  as  a  whole  and  for  each 
caseworker — in  what  sense  are  they  managing  their  implementation  of 
CalWORKs? 

CONCLUSION 

In  summary,  CalWORKs  massively  increased  the  county  welfare 
department's  workload,  requiring  them  to  add  capacity — staff, 
contractors,  or  both.  Bringing  that  additional  capacity  on-line  took 
time.  Only  once  the  additional  capacity  was  on-line  could  the  work  of 
actually  moving  the  new  and  existing  cases  through  the  early  steps  of 
the  CalWORKs  model  proceed.  In  many  counties,  that  capacity  did  not 
come  on-line  until  the  summer  of  1999  or  later.  Moreover,  because 
CalWORKs  is  a  work- first  program,  large  numbers  of  referrals  to 
education,  training,  and  treatment  for  mental  health,  substance  abuse. 
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and  domestic  abuse  problems  would  not  be  expected  until  cases  complete 
these  early  steps  of  the  CalWORKs  model. 

In  counties  that  have  enough  capacity  in  place,  the  bulk  of  cases 
should  have  signed  welfare-to-work  plans  in  the  last  few  months. 

Assuming  that  the  county  is  screening  heavily  and  making  referrals 
consistent  with  the  results  of  the  screening,  the  level  of  referrals 
should  rise  sharply. 

I  conclude  with  a  list  of  issues  for  the  future,  which  are  shown  in 
Figure  4 : 

•  Has  a  county  added  enough  capacity? 

•  Are  cases— existing  and  new-moving  through  the  early  activities 
fast  enough?  And, 

•  Are  outcomes  being  monitoring? 


Issues  for  the  Future 


•  Has  a  county  added  enough  capacity? 

•  Are  cases — existing  and  new — moving  through 
early  steps  fast  enough? 

•  What  outcomes  are  being  monitored? 
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Figure  4 --Issues  for  the  Future 


